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Personal  Software  Process,  PSP,  Team  Software  Process,  and  TSP  are  service  marks  of  Carnegie  Mellon  University 


Presentation  Objectives 


•  Background  of  AV-8B  JSSA 

•  Evolution  of  Launch  Processes 

•  Evolution  of  Periodic  Team  Meeting  Processes 

•  Performing  Coordinator/Manager  Roles 

•  Evolution  of  Postmortem  Processes 


Personal  Software  Process,  PSP,  Team  Software  Process,  and  TSP  are  service  marks  of  Carnegie  Mellon  University 
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AV-8B  JSSA  Background 


Overview 

-  Provide  AV-8B  life-cycle  systems 
development,  operation  and  maintenance 
support  to  the  United  States  Marine  Corps, 
Italian  Navy  and  Spanish  Navy 

-  Located  at  China  Lake,  California 

-  Weapon  System  Support  Activity  (WSSA) 
established  in  1985 

-  Joint  System  Support  Activity  (JSSA) 
established  in  1992  upon  partnership  with 
the  Spanish  and  Italian  Governments 

-  70-80  personnel;  10-15  s/w  engineers 

Goal 

-  Release  Operational  Flight  Program  (OFP) 
and  Mission  Planning  Maintenance  Releases 
when  needed  by  the  fleet 
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TSP  Milestones  at  AV-8B 


Start  PSP/TSP  Training  (10/2000) 

1st  TSP  Launch  02/2000) 

JSSA  receives  CMM  Level  2  (Spring  2001) 

TSP  becomes  org  standard  s/w  process  (6/2002) 

JSSA  receives  CMM  Level  4  (Fall  2002) 

1st  Non-SW  Launch  (4/2006) 

Start  TPI  Pilot  (9/2006) 


2001 


2002 


2003 


2004 


2005 


2006 


2007 


2008 
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Launch  Process  Evolution 

•  Launch  Preparation 

-  Past:  little  to  no  preparation 

-  Problems: 

•  frustration  from  estimating  without  enough  time 

•  less  confidence  in  ability  to  execute  plan 

-  Present:  components  estimated  by 
individuals  &  team  lead  beforehand 

•  more  insightful  discussions  on  extent  of  work  to  be 
performed 

•  deeper  understanding  of  the  team’s  undertaking 

•  fewer  surprises  during  the  launch 
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Ejjj  HAE  ROM.doc  -  Microsoft  Word 


File  Edit  View  Insert  Format  lools  Table  Window  Help 


Type  a  question  for  help  ^  x 


VI 


=  13 


m 


Page  1 


Sec  1 


A 


HAE ROM 
(1,149  SLOCS  TOTAL) 

Engr  1  assumed  to  work  unless  otherwise  stated 

PR  2847  -  Implement  DTED  Capability  in  the  AV-8B  (400  SLOCSLc  Component 
“PR2847  -  Add  HAE  Table”  -  Rate  5  SLOC/Hr  -  Classic  Lifecycle 
Engr  2 

The  design  will  be  integrated  with  HAE  to  create  aFafade  to  handle  all  Altitude 
requests  and  interface  with  calls  to  getting  DTED  data.  The  Facade  estimates 
were  based  on  looking  at  existing  Facades  for  QV  VSTOLREST  and 
EVPointFacade.  The  Estimate  for  .cpp  is  300  SLOCS  (GctMSL  GetiHAE, 

VWWWWWWWWWWWWWv  ■■.■■■J.-viv-  Vwwwwwwwv^  VWWVWWVWW^ 

ComputeMSL.  ComputeHAE  and  Interpolation  routines). 

VvWWv^AWAWMWAA?  W^WAvJ^WWvVvW^WA■  JT  / 

Estimate  for  .his  100  SLOCS  for  definitions. 

Estimate  for  DTED  Table  will  be  provided  and  is  assumed  Plug  and  Play. 

STR  6800  -  ID  AM  Transition  to  HAE  for  Target  Altitude  Reference  (10  SLOCS)  - 
Component  “STR6S00STR7571  -  Enter  and  Send  HAE  to  JDAM”  -  Total  185  SLOC 
Rate  5  SLOC/Hr  -  Lite  Lifecycle  -  Med  (Engr  4  to  work) 

Engr  3 

The  design  on  this  is  an  Interface  change  to  set  a  bit  indicating  that  the  elevation 
value  is  either  MSL  or  HAE. 

STR  7571  -  Allow  for  HAE  Elevation  Entry  for  JDAM  (175  SLOCS)^  Combined 
with  Component  “STR6800  STR7571  -  Enter  and  Send  HAE  to  JDAM”  (Engr  4  to 
work) 

Engr  3| 
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Launch  Process  Evolution 


•  Estimating  S/W  Maintenance  Efforts 

-  Past:  used  LOC  as  size  measure 

-  Problems: 

•  actual  A&M  LOC  counts  had  no  correlation  to 
actual  effort 

-  Present:  using  problem  type  categories  as 
size  measure 

•  overall  time  estimates  are  within  7%  of  actuals 
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Launch  Process  Evolution 


Object  Category  Size  table  for  C++  (in  LOCs/method) 


Type 

VS 

s 

M 

L 

VL 

Calculation 

2.34 

5.13 

11.25 

24.66 

54.04 

Data 

2.60 

4.79 

8.84 

16.31 

30.09 

I/O 

9.01 

12.06 

16.15 

21.62 

28.93 

Logic 

7.55 

10.98 

15.98 

23.25 

33.83 

Set-up 

3.88 

5.04 

6.56 

8.53 

11.09 

Text 

3.75 

8.00 

17.07 

36.41 

77.66 

Problem  Category  Size  table  for  AV-8B  OFPs  (in  Hours/STR) 


Type 

Small 

Med 

Large 

Extra 

Large 

STR 

6 

17 

35 

60 
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Launch  Process  Evolution 


Size  Bin  Counts  of 
Actual  Efforts  for  STRs  in  H2.0 


Size  Bins 
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Launch  Process  Evolution 


AV-8B  H2.0  STR  Proxy  Errors 


(understimated) 

60% 


40% 


20% 


LU 

Q) 

N 


S  0% 

CO 

3 

|  -20% 


40% 


-60% 


(overstimated) 


13.5 


20.5  42.5  52.5 

STR  Size  Categories 

AV-bB  S I  K  Category  Distribution 


AV-8B  H4.0  Cycle  1  STR  Proxy  Errors 


(understimated) 
60% 


40% 


2  20% 

1- 

LU 

I  0% 

CO 


AV-8B  H4.0  Cycle  3  STR  Proxy  Errors 


(understimated) 
60% 


40% 


5  20% 

S— 

LU 

I  « 

CO 

3 

|  -20% 


-40% 

-60% 

(overstimated) 


17  40  75 

STR  Size  Categories 


overall 


17  35 

STR  Size  Categories 


overall 
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Launch  Process  Evolution 

•  S/W  Maintenance  Life-cycle  Process 

-  Past:  used  “classic”  TSP  life-cycle 

-  Problems: 

•  no  problem  identification  phase 

•  did  not  fit  iterative  nature  of  finding  the  root  cause 

-  Present:  using  “Lite”  life-cycle 

•  simple  life-cycle  good  for  small  STRs 

•  natural  for  iterative  nature  of  finding  the  root  cause 
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Launch  Process  Evolution 


HLD 

HLDINSP 

1  IDENT 
► 

-/ 

-  high-level  problem  analysis 

DLD 

DLDR 

DLDINSP 

A 

A  INWRK 

| 

CODE  \ 

CR  \ 

-  design,  code,  and  unit  test  activities 

CODEINS^\ 

COMPILE  \ ' 

UT  | 

*  INSP 

-  inspection  of  design  and  code  products 

IT 

IT 

-  lab  test/verification  performed  by  developer 

ST  | 

RA 

-  determination  of  need  for  re-work 

ST 

-  re-work  triggered  by  failure  during  final  testing  | 
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Meeting  Process  Evolution 

•  Preparation  of  Data  Before  the  Meeting 

-  Past:  little  to  no  collection  or  review 

-  Problems: 

•  wasted  time  analyzing  incomplete/corrupt  data 

•  longer  time  relaying  status  (“Ummm. . 

•  longer  time  looking  for  data  (“Where  is  that  file?”) 

-  Present:  reports  generated  and  compiled 

•  coordinators  generate  reports  in  common  folder  on 
server 

•  status  documented  in  common  set  of  PowerPoint 
slides 
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Team  Leader’s  Time  (5  Min) 


UPC  Day  at  Eglin  AFB  01/08-09 

-  latest  JMPS  schedule  to  be  announced  then 

-  XXX  will  be  at  the  meeting 

When  should  we  plan  for  t1  '  ™  ’’ 


mid  3  be  made? 


Team  &  Individual  Status 


Team  Status 

-  Earned  Value 

-  Time  on  Task 


(30  mins) 


-  Weekly  View 


Individual  Status’  (each  team  member) 

-  How  things  went  last  week 

-  Problems  they  are  encountering 


Planning  Coordinator 


•  All  workbooks  need  to  be  submitted  the  last  working  day  of  the  week  in  order  for 
rollups,  slides  and  analysis  to  be  done  before  the  weekly  meetings.  Any  workbooks  that 
are  not  received  by  8  AM  each  Monday,  the  assumption  will  be  that  last  weeks  data  is 
the  most  current  and  include  it  for  the  rollup  and  analysis.  Keep  in  mind  that  if  this 
occurs,  Earned  Value  and  schedule  will  be  affected. 


•Please  send  all  workbooks  and  slides  at  the  end  of  the  week  not  only  to  me  but  also  to 
XXX  (  )  and  YYY  ( 


Current  Status 


The  team  is  currently  3  weeks  behind 


Current  Status 


Plan 


Direct  Hours 


Actual  Actual/Plan 


This  Week 

42:00 

To  Date 

242:00 

Average  per  Week  To  Date 

34:35 

Completed  tasks  to  date 

88:57 

72:04 


260:38 


sy  r“j  -t 

-  /  /  •  JL  v ' 


124:24 


1.72 


1.08 


1.08 


.4 


Earned  Value 


Plan  Actual  Actual/Plan 


8%  5.7%  0.71 


31.5%  12.3%  0.39 


4.5%  1.76%  0.39 


►Our  Earned  Value  to  date  is  lower  then  we  planned. 

►The  team  is  spending  more  hours  then  planned  on  tasks  that  are  completed. 
►The  team  has  136  hrs  (3.2  team  weeks)  invested  in  uncompleted  tasks. 


Quality  Coordinator  Report 


Defect  ratios: 


-  DLD  Review/Unit  test  Planned  1.6,  Actual  0.26 


it  te 
•  • 


-  Code  Review/Compile  Planned  1.9,  Actual  0.89 


ual 

:ual 


Process  Coordinator  Report 


Introduced  PIP  Tracker 

-  J:\Project  Notebook\PIPs\PROJECT  X  PIP  Tracker.xls 

New  PIPs  (#) 

Newly  Assigned  PIPs  (#) 

Newly  Closed  PIPs  (#) 

PIP  Board  will/will  not  meet  today 

-  PIPs  that  will  be  covered 


that  \ 
VC  E 


Still  have  EV  PIPs  open. 


Support  Coordinator  Report 


As  of 
1211/02 


RNL 


DLC 


Test  Coordinator  Report 


change 


all  passed 


build  2-3 


build  3.0 


Build  3.1 


1 6-Dec-02 


Build  3.2 


23-Dec -02 


| scri pt  file 


#  tests 


#  errors 


%  passed  #  tests 


#  errors 


%  passed 


#  tests 


#  errors 


%  passed 


#  tests 


#  errors 


%  passed 


DLB 


mission_main.txt 
aircraft_init.txt 
aircraft_main.txt 
aircraft  file.txt 


LoadRalt_init.txt 

20 

0 

100 

20 

0 

100 

20 

0 

100 

20 

0 

100 

LoadRalt_main.txt 

164 

0 

100 

164 

0 

100 

164 

0 

100 

164 

0 

100 

LoadRalt_file.txt 

67 

0 

100 

67 

0 

100 

67 

0 

100 

67 

0 

100 

VSTOL_init.txt 

8 

0 

100 

8 

0 

100 

8 

0 

100 

8 

0 

100 

VSTOL_main.txt 

56 

0 

100 

56 

0 

100 

56 

0 

100 

56 

0 

100 

VSTOL  file.txt 

34 

Q 

100 

34 

0 

100 

34 

0 

100 

34 

0 

100 

FlightCardsARCI  82  init.txt 

17 

0 

100 

17 

0 

100 

17 

0 

100 

17 

0 

100 

FlightCardsARCI 82  main. t> 

11108 

0 

100 

11108 

0 

100 

11108 

0 

100 

11108 

0 

100 

FlightCardsARCI  82_file.txt 
LoadWpnProg_init.txt 
LoadWpnProg_main.txt 
LoadWpnProg_file.txt 
LoadC1_init.txt 
LoadC1_main.txt 
LoadC1_file.txt 
LoadEALE39_init.txt 
LoadEALE39_main.txt 
LoadEALE39_file.txt 
LoadExt_init.txt 
LoadExt_main.txt 
LoadExt  file.txt 


100 


100 


100 


425 


too 


425 


100 


425 


100 


425 


100 


totals 

a\4mps integrati0n.txt 

21771 

227 

97 

Environment  init.txt 

30 

0 

100 

30 

0 

100 

30 

0 

100 

Environment_main.txt 

74 

0 

100 

74 

0 

100 

74 

0 

100 

Environment file.txt 

98 

0 

100 

98 

0 

100 

98 

0 

100 

|  totals 

avjmps  integration.txt 

22815 

304 

99 

FSPR 

ODUSequence  init.txt 

2 

0 

100 

2 

0 

100 

ODUSequence  main.txt 

nni  lQnm.nnno  nln  tvf 

TJM 

U U U o6(^ U6I1C6  TII6.tXt 

ATHS  init.txt 

ftTUC  inif  fvi 

a  1  no  init.txt 

ATHS  init.txt 

totals 

avjmpsJntegration.txt 

22817 

304 

99 

22817 

304 

99 

Goals,  Risks,  &  Action  Items 


Goals  Status :  See  Goals  spreadsheet 


Risks  Status :  See  Risks  spreadsheet 


Action  Items  Status :  See  Action  Item  spreadsheet 


Meeting  Wrap-up  (5  min) 


•  Read  new  Action  Items 

•  Risk  and  Goal  reminders  for  next  meeting 


Meeting  Process  Evolution 


•  Documenting  the  Meetings 

-  Past:  used  weekly  meeting  form 

-  Problems: 

•  meeting  data  spread  across  files 

•  additional  effort  to  collect  and  track  Action  Items 

-  Present:  uses  custom  meeting  log  spreadsheet 

•  tracks  meeting  attendance,  decisions,  action  items,  risks, 
and  goals 

•  “one  stop  shopping”  with  all  the  data  together 
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EH  Microsoft  Excel  -  AV-8B  Sample  Team  Meeting  Log.xls 


File  Edit  View  Insert  Format  Tools  Data  Window 

A26  ▼  fa 


Help 


Type  a  question  for  help 


A 

B 

C 

D 

E 

F 

G  ^ 

1 

Software  Team 

2 

Team  Members 

Date 

08/01/06 

08/08/06 

08/15/06 

08/22/06 

3 

Start  Time 

14:00 

14:00 

14:00 

14:00 

4 

End  Time 

15:30 

16:00 

15:15 

16:00 

5 

Delta  Time 

1:30 

2:00 

1:15 

2:00 

0:00 

6 

Engineer  1 

1 

7 

Engineer  2 

1 

1 

1 

1 

8 

Engineer  3 

1 

1 

1 

1 

9 

Engineer  4 

1 

1 

10 

Engineer  5 

1 

1 

1 

11 

Engineer  6 

1 

1 

1 

1 

12 

Engineer  7 

1 

1 

1 

1 

13 

Engineer  8 

1 

1 

1 

14 

Engineer  9 

1 

1 

1 

1 

15 

Engineer  10 

1 

1 

1 

1 

16 

Engineer  1 1 

1 

1 

^—1 

17 

Engineer  12 

1 

1 

18 

Engineer  13 

1 

1 

1 

1 

19 

H  4  ► 

►1 1|\  Attendance  /  Decision  /  Action  Items  /  Team  Risks 

/  Goals  /  Roles  / 

Jjd 

l 

L  ►r 

Ready 
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□  Microsoft  Excel  -  AV-8B  Sample  Team  Meeting  Log.xls 


■^1  File  Edit  View  Insert  Format  lools  Data  Window  Help 
^  C22  £ 


Type  a  question  for  help 


*  _  x 


A  B  C 

D 

1 

2 

Software  Team  Decision  Log 

3 

# 

Dale 

Created 

Decision  Item 

Reason  /  Discussion 

4 

i 

8/1/2006 

Quality  Coordinator  will  attend  the  PCRB 

Because  they  have  to  report  PR  status  anyway. 

5 

2 

8/2/2006 

Integration  testing  will  not  be  signed  off  for  new  messages.  A  table 
inidicating  the  messages  to  be  tested  will  be  created  by  the  interface 
developer.  As  other  software  components  are  completed  and  ready  for  test, 
the  interface  developer  will  take  the  table  and  verify  which  messages  were 
exercised  by  the  other  components  that  use  the  interface.  Any  changes  that 
need  to  be  made  to  the  interface  will  be  done  as  a  defect  under  the 
integration  test  section  of  the  interface  developers  plan.  Integration  testing 
cannot  be  signed  off  for  interface  changes  until  the  messages  in  the  table 
have  all  been  tested  and  signed  off  by  the  interface  developer. 

6 

3 

8/3/2006 

F  or  Insp  e  ctions,  the  author  will  get  full  time  and  e  ach  insp  e  ctor  will  get  50% 
of  the  authors  time. 

This  is  what  was  done  in  H4.0. 

7 

4 

8/3/2006 

Design  coordinator  will  determine  Lifecycle  to  be  used  on  new  components 
added  to  plans  and  report  to  T earn  Leader  before  creating  them  in 

Dashboard. 

The  classic  lifecycle  may  add  too  much  overhead  for  scope 
of  work  to  be  done. 

8 

5 

8/3/2006 

Planning  Coordinator  will  report  any  newly  added/delete  d/changed 
components  at  the  weekly  meeting. 

To  keep  the  team  and  team  lead  informed. 

9 

6 

8/3/2006 

ASTRO  testing  will  use  the  Lite  Lifecycle 

Because  they  require  no  architecture. 

10 

7 

8/4/2006 

Move  XX  to  WMC  DMLGB  when  DTE  tasking  os  completd.  Move  YY  to 
MSC  DMLGB  after  his  current  tasking  is  completed 

XX  and  YY  are  under  tasked 

11 

8 

8/4/2006 

in  WMC  project,  Integration  test  phases  were  removed  from  the  11 JDAM  to 
DMLGB  Conversion"  components 

integration  testing  is  not  possible  at  this  time  in  development 

12 

9 

8/4/2006 

for  tasks  giving  to  Heath  and  Stephanie,  we  are  halving  the  rates  for  the 
phases  of  the  components 

10 

8/4/2006 

minimums  for  inspections  are 

HLD  Inspection  1  hr  for  author  0.3  for  inspector 

T--.T  i~-.  t -  ...  -  _±:  -  -  i  i. ..  r- . 4.-1.  _  ..  n  -r  _±  _  .. 

if  the  component  has  a  small  sloe  size,  then  the  percentages 
used  in  the  lifecycle  often  do  not  allocate  enough  time  for 

H  i  ►  m|\  Attendance  \  Decision/  Action  Items  /  Team  Risks  /  Goals  /  Roles  /  \<\  ► 

Ready 
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Meeting  Process  Evolution 


0  Microsoft  Excel  -  AV-8B  Sample  Team  Meeting  Log.xls 


iBl  1  File  Edit  View  Insert  Format  Tools  Data  Window  Help 

B77  -  f* 


Type  a  question  for  help  ▼  _  x 


A 

B 

c 

D 

E 

F 

1 

Stakeholders 

Goal 

Measures 

Tracking 

2 

Goal 

Actual 

Who 

When 

46 

Team  Goals 

47 

Quality:  For  new  dev,  have  reasonable  defect  density  in  ST  phase  (not 
including  defects  injected  by  having  inadequate  reqts) 

MSC&WMC:  2.5  PRs  in 

ST  phase  per  KLOC  N&C 

code 

DTE:  2.5  PRs  in  AT  phase 
per  KLOC  N&C  code 

UPC:  2.5  PRs  in  ST  phase 
per  KLOC  N&C 

Engr  1 

Weekly 

48 

Quality:  For  new  dev,  have  90%  Yield  before  Unit  Test  Phase  (not 
including  defects  injected  by  having  inadequate  reqts) 

90%  Process  Yield  before 

Unit  Test 

Engr  1 

Weekly 

49 

Schedule:  Stay  close  to  the  planned  schedule 

Actual  progress  is  no  more 

than  2  weeks  behind 

schedule 

Engr  2 

Weekly 

50 

Technical:  Improve  exposure  of  Software  Engineers  to  various 
products  supported  by  software  team. 

Create  and  Maintain  list 

showing  engineers 
exposure  to  various 
developed  products.  Have 
at  least  2  deep  in  all  product 

areas. 

Engr  3 

Every  2 

Months 

(S/14/06) 

51 

52 

53 

54 

55 

56 

Z 


Ready 


a 


NAV&A\  R 


NAVAIR  Software/Systems  Support  Center  (NSSC) 


Slide  32 


C  Microsoft  Excel  -  AV-8B  Sample  Team  Meeting  Log.xls 
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Manager  Roles 


•  Past:  spotty  execution  of  roles  (at  best) 

•  Problems: 

-  roles  were  perceived  as  a  distraction  from  “real  work” 

-  planning  manager  performed  out  of  necessity 

•  Present:  use  of  coordinator  scripts 

-  use  coordinators  (instead  of  managers)  to  remind  them  they  are 
coordinating  efforts  to  address  issues 

-  scripts  are  defined  to  assist  execution 

-  scripts  remind  how  to  perform  the  steps 

-  role  reports  are  part  of  the  meeting  agenda 
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Sample  Quality  Coordinator  Checklist  -  AV-8B.doc  -  Microsoft  Word 


File  Edit  View  Insert  Format  Tools  Table  Window  Help 


dQid 

Type  a  question  for  help  ^  x 


v  1  ^  2  -  3  ■  ......  4.  5  ■  ■ 

HOW  TO  PERFORM  ACTIVITIES 

Defect  Log 

•  Is  every  defect  injected  in  pearlier  phase  than  where  it  is  removed? 

•  Does  each  defect  have  a  fix  time? 

•  Is  there  a  clear  description  of  the  cause  for  each  defect? 


Team  Dashboard  ->  select  proper  project  ->  Project  Summary  (under 


script  button)  ->  select  Dev  ->  Defect  Reports  ->  View  Defect  Log  ->  Ex¬ 
port  to  Excel  ->  AutoFilter  ->  filter  for  defects  entered  since  last  week 
Are  total  defect  fix  times  for  a  phase  consistent  with  the  total  time  in  the 
phase  on  the  planning  summary?  Generally,  fix  time  must  be  <  total  time  in 
phase,  and  for  testing,  fix  time  +  time  to  run  tests  should  be  roughly  equal  to 
total  time  in  phase. 

•  Team  Dashboard  ->  Task  &  Schedule  ->  Report  ->  export  to  Excel  -> 
AutoFilter ->  filter  for  defect  removal  phases  signed  off  since  last  week 
:or  each  phase  of  each  component  signed  off:  Add  up  fix  times  for  defects 
emoved  during  that  phase  and  compare  sum  to  actual  time  spent  in  that 

phase 


Reviews  and  Inspections 

•  Are  defects  discovered  during  inspection  recorded  in  the  author's  workbook? 

•  Are  review/inspection  rates  about  200  LOC/hour? 

•  Do  all  the  engineers  have  design  and  code  review  checklists? 

•  Are  all  the  engineers  using  their  design  and  code  review  checklists? 

General 

•  Is  component  quality  profile  indicator  being  reviewed  before  integration  test? 
(spider  chart) 


d 


Team  Dashboard  ->  Task  &  Schedule  ->  Report  ->  export  to  Excel  -> 
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E  Microsoft  EkccI  -  Week  Ending  2007040Q.kIs  [Read-Only] 


^JnjjsJ 


File  Edit  View  Insert  Format  Tools  Data  Window  Help  Type  a  question  for  help  t  _  fi1  X 
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Postmortem  Process  Evolution 

•  Past:  no  analysis  or  preparation  prior  to 
meeting 

•  Problems: 

-  team  watching  a  few  figuring  out  how  to  analyze  data 

-  only  obvious  trends  were  found 

-  focus  on  time-in-phase  %  and  average  productivity  rate 

•  Present:  serious  preparation  for  meeting 

-  Lite  life-cycle  data  is  evaluated  for  possible  problem 
type  category  changes 

-  individuals  evaluate  own  data  to  identify  work  rates 
(and  report  what  they  find) 

-  team  learns  to  use  statistical  methods 
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TSP  Postmortem  Prep  Activities  For  5W.doc  -  Microsoft  Word 


File  Edit  View  Insert  Format  Tools  Table  Window  Help 


^JnJxJ 

Type  a  question  for  help  ^  x 
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Step 

Activities 

Description 

Who  can  prep 

1 

Meeting  Roles 

Select  the  meeting  roles  (specification  ROLE). 

-  The  launch  coach  leads  the  meeting  (script  MTG). 

-  The  timekeeper  tracks  time  and  keeps  the  meeting  on  schedule. 

-  The  recorder  notes  meeting  decisions  and  actions  and  writes  the  meeting 
report  (form  MTG). 

No  prep  needed 

2 

Baseline 

Evaluation 

The  support  manager  leads  the  team  in  evaluating 

-  the  adequacy  of  the  configuration  management  process 

o  Did  team  members  work  around  it?  (go  ask) 
o  Did  anyone  have  trouble  with  it  (lost  changes,  waiting  for 
others  to  check  a  file  back  in,  etc)? 

-  the  adequacy  of  the  system  baseline 

o  Did  the  team  have  one? 
o  Did  everyone  know  what  it  consisted  of? 
o  How  many  baselines  were  established  during  the  period 
being  PMed? 

Q  VWWWW 

-  the  adequacy  of  the  development  environment. 

Support 
coordinator  get 

answers  to  questions 

3 

Plan  Evaluation 

The  planning  manager  leads  the  evaluation  of  team  performance. 

-  compare  actual  versus  plan  schedule  (i.e.,  hours  per  week) 

-  for  each  product  type,  compare  actual  versus  plan  for 

o  Size  of  pro  duct 

o  Resource  (i.e.,  hours  to  perform  the  completed  tasks) 
o  Productivity  (size  measure  per  hour) 
o  %  Time  in  Phase  for  each  process  used 

Planning 

coordinator  looks  at 
overall  team 
numbers  and  ensures 
that  all  individual 
team  members 
analyze  their  own 
numbers 

How  many  LOE  hours  were  logged?  "What  topics  were  they  spent  on 
(training,  launch,  etc)? 

Planning 
coordinator  (or 
delegated) 

4 

Quality 

Performance 

The  quality  manager  leads  the  evaluation  of  team  performance. 

-  quality  of  the  products  produced 

-  team  performance  versus  the  goals  and  quality  plan 

-  for  each  product  type,  complete  a  PM  Quality  Factors  spreadsheet 

Quality  coordinator 

5 

Planning  Data 

Provide  updated  planning  data. 

1~\  H  ^  H  H  '  .-*4  H  \ 

No  prep  needed,  the 
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Postmortem  Process  Evolution 


•  Example:  Rouge  STRs 

-  Early  PMs  identified  STRs  with  high  actual  hours  as  outliers 

-  Later  PMs  discovered  trend  across  projects  of  5-8%  rouge  STRs 

-  Current  plans  estimate  1  in  10-20  STRs  will  be  rouge  (>60  hrs) 

AV-8B  STRs  needing  Significant  Labor 
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Summary 


•  What  AV-8B  S/W  Team  is  learning: 

-  Launch  preparation  means  smoother  launches 

-  S/W  maintenance  needs  a  difference  life-cycle 

•  (you  don’t  have  to  be  right  the  first  time  with  a  new 
process) 

-  Meeting  preparation  means  smoother  meetings 

-  Data  analysis  leads  to  process  improvement 

•  (all  team  members  need  to  be  involved) 
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Contact  Information 


•  Chris  Rickets  (AV-8B  Sr.  Software  Engr) 

-  phone:  (760)  939-5838 

-  e-mail:  chris.rickets@navy.mil 

•  Brad  Hodgins  (NAVAIR  TSP  Coach  supporting  AV-8B  ) 

-  phone:  (760)  939-0666/4446 

-  e-mail:  bradley.hodgins@navy.mil 
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Abbreviations 


•  CMM  -  Capability  Maturity  Model  (Software) 

•  CMMI  -  Capability  Maturity  Model  Integration 

•  JSSA  -  Joint  Systems/Software  Support  Activity 

•  NAVAIR  -  Naval  Air  Systems  Command 

•  NSSC  -  NAVAIR  Systems/Software  Support  Center 

•  OFP  -  Operational  Flight  Program 

•  PSP  -  Personal  Software  Process 

•  SEI  -  Software  Engineering  Institute 

•  STR  -  System  Trouble  Report 

•  TPI  -  Team  Process  Integration 

•  TSP  -  Team  Software  Process 
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